■■■ - . \3.lpAh 10/527234 

©T19.8ej^dPCT/PT0 0 9 MAR 2005 

DESCRIPTION 

DATA RECEPTION TERMINAL AND MAIL CREATION METHOD 



5 TECHNICAL FIELD 

The present Invention relates to a data reception terminal 
and a mail creation method, and more particularly to a data reception 
terminal that creates, by utilizing information associated with 
multimedia data (e.g., images, sounds, and the like) which is 
10 received via broadcast , communication, or the like, an electronic 
mail relating to the multimedia data and a mail creation method 
to be performed in the data reception terminal. 

BACKGROUND ART 

15 In recent years , TV program broadcast has been experiencing 

a rapid conversion from analog to digital form. The digital 
broadcast has been putting various services, which had been 
difficult for the analog broadcast to provide, to practical use. 
One example is data broadcasting seirvices. According to a data 

20 broadcasting service, a user who is viewing a TV program is capable 
of easily obtaining information such as weather forecast , a 
homepage URL of the TV program that is being viewed, and the like, 
via broadcast. As a description format for data which is used 
in the data broadcasting service, BML (Broadcast Markup Language) 

25 is generally known. 
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Meanwhile, the sophistication of functionality of mobile 
phones has been progressing rapidly. Conventionally, a main 
service provided by mobile phones has been voice communication, 
but at present, homepage browsing and electronic mall are 
5 Indispensable . In particular, electronic mall has been replacing 
voice communication as a main seirvlce. 

With the situation as described above. In recent years, as 
mobile phones are beginning to have a digital broadcast receiving 
function, a compound service combining a digital broadcast 

10 receiving function and a mall communication function Is proposed. 
The "compound service" refers to, for example, a service In which. 
If a user specifies a scene while viewing a TV program, an electronic 
mall containing attached Information relating to the specified 
scene (scene-related Information) Is transmitted to a designated 

15 destination. Here, a "scene" refers to a part of a TV program, 
and means broadcast data which Is uniquely specified by time, a 
channel that Identifies the program, and/or the like. 

An exemplary structure of a conventional mobile phone which 
realizes such a compound service Is shown In FIG. 12. As shown 

20 In FIG. 12, the conventional mobile phone Includes a broadcast 
receiving section 1201, a decoding section 1202, an video/audio 
output section 1203, a related Information storage section 1204, 
a related Information retrieval section 1205, an Input/output 
acceptance section 1206, a mall creation section 1208, and a mall 

25 communication section 1209 . The broadcast receiving section 1201 
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receives multiplexed data of a TV program whlcli Is broadcast from 
a TV station. The decoding section 1202 separates the received 
multiplexed data Into video/audio data and broadcast data. The 
video/audio output section 1203 outputs video and audio. The 
5 related Information storage section 1204 stores and manages the 
broadcast data. The Input /output acceptance section 1206 detects 
a user's specifying of a scene, and generates predetermined scene 
specification Information. The related Information retrieval 
section 1205 retrieves corresponding scene-related Information 

10 based on the scene specification Information. The mall creation 
section 1208 creates an electronic mall to which Is attached the 
retrieved scene-related Information. The mall communication 
section 1209 transmits the created electronic mall. 

In the conventional technology above, however, although It 

15 Isposslble to automatically attach, as scene-related Information, 
Information such as the URL of a homepage of a TV program or the 
like to an electronic mall, a user has to Input and create by 
operating keys as often as necessary a content the user desires 
to convey to the other party as the body of the electronic mall. 

20 As a result, there occurs a problem In that It tedces a long time 
from when a scene Is specified until an electronic mall Is 
transmitted. Consequently, In the case of a TV progreun In which 
scenes change from moment to moment. It Is conceivable that a scene 
Irrelevant to the content of an electronic mall Is being broadcast 

25 at the moment that the transmission of the electronic mall Is 



completed. This problem also applies to the case where the 
multimedia data Is music which Is broadcast from a radio station. 

Therefore, an object of the present Invention Is to provide 
a data reception terminal and a mall creation method which. In 
5 the case where Information related to multimedia data Is to be 
transmitted via electronic mall, makes It possible to perfoirm the 
creation of an electronic r^all easily and accurately, by providing 
assistance In user Input operation when creating the body of the 
electronic mall. 

10 

DISCLOSURE OF THE INVENTION 
The present Invention Is directed to a data reception 
terminal for receiving multiplexed data obtained by multiplexing 
multimedia data Including at least video or audio and scene-related 

15 Information related to the multimedia data, and creating an 
electronic mall by utilizing the multiplexed data. To achieve 
the object above , a data reception terminal according to the present 
Invention comprises a receiving section, a decoding section, an 
output section, a storage section, an Input /output acceptance 

20 section, a retrieval section, a format conversion section, and 
a mall creation section. 

The receiving section receives the multiplexed data. The 
decoding section separates the received multiplexed data Into the 
multimedia data and the scene-related Information. The 

25 Input /output acceptance section generates , In response to a request 
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from a user, scene specification Information for Identifying a 
portion of the multimedia data that Is being outputted from the 
output section, the scene specification Information Including 
Identification Information and time. The retrieval section 
5 retrieves, from the storage section, scene-related Information 
corresponding to the scene specification Information. The format 
conversion section converts the retrieved scene-related 
Information Into a format which enables the scene-related 
Information to be used In the electronic mall . The mall creation 

10 section creates a part of data of the electronic mall by utilizing 
the converted scene-related Information. 

Here, preferable methods for creating an electronic mall 
employed by the mall creation section are, for example: creating 
a body section of the data of the electronic mall from the 

15 scene-related Information; setting, as a subject of the electronic 
mall, a part of the scene-related Information corresponding to 
a title; and displaying. In the electronic mall, data of the 
electronic mall created from the scene-related Information In a 
form different from that of any other Information contained In 

20 the electronic mall. It Is desirable that data of the electronic 
mall created from the scene -related Information be protected so 
that a content of the scene-related Information Is not allowed 
to be changed. 

The processes performed by the afore -mentioned components 
25 of the data reception terminal can be regarded as a mall creation 



method defining a sequence of processing steps. This method Is 
provided In the form of a program for causing a computer to execute 
the series of processes . This program may be Introduced Into the 
computer via a computer-readable recording medium having the 
5 program recorded therein. In addition, all or some of the 
functional blocks that constitute the afore -described data 
reception terminal may be realized as an LSI , which Is an Integrated 
circuit . 

As described above , according to the present Invention , text 
10 data (I.e. , scene-related Information) for an electronic mall Is 
extracted from Information associated with a specified scene. 
Consequently, It becomes possible to create the electronic mall 
In a short time and with ease. In particular, the body of an 
electronic mall can be created by only Inputting words to be added 
15 between text data. Moreover, the operation of Inputting the 
subject of an electronic mall by a user can be omitted . Furthermore , 
It Is possible to visually distinguish between scene-related 
Information and a part Inputted by a user within the body of an 
electronic mall. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG . 1 Is a diagram Illustrating an outline of a communication 
system to which a data reception terminal of the present Invention 
Is applied . 

25 FIG. 2 Is an external view of an exemplary data reception 
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terminal according to an embodiment of the present invention. 

FIG. 3 is a diagreun illustrating a typical hardware 
configuration for realizing a data reception terminal. 

FIG. 4 is a diagram illustrating a software configuration 
5 of a data reception terminal which employs a mail creation method 
according to an embodiment of the present invention. 

FIG. 5 is a flowchart of the processes concerning a broadcast 
receiving function of a data reception terminal. 

FIG. 6 is a flowchart of the processes concerning an 
10 electronic mail transmission function of a data reception terminal . 

FIG. 7 is a diagram illustrating a specific example of 
broadcast data which is associated with multimedia data. 

FIG. 8A and FIG. 8B are diagrams illustrating specific 
examples of scene specification information. 
15 FIG. 9 A and FIG. 9B are diagrams illustrating an example 

where a plurality of services are provided by one channel. 

FIG . 10 is a diagram illustrating an exemplary display screen 
in which scene-related information is put in an electronic mail. 

FIG . 11 is a diagram illustrating an exemplary display screen 
20 after the body of the electronic mail shown in FIG. 10 has been 
edited. 

FIG. 12 is a diagram illustrating a software configuration 
of a conventional mobile phone. 

25 BEST MODE FOR CARRYING OUT THE INVENTION 
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An embodiment of the present Invention Is described below 
with reference to the accompanying drawings. 

Firstly, there Is described an outline of a communication 
system In which a multimedia digital distribution service and an 
5 electronic mall service are combined, and to which a data reception 
terminal of the present Invention Is applied. FIG- 1 Illustrates 
an example where a TV program composed of multimedia data Including 
video, audio, and various data Is distributed from a broadcasting 
station 101 to a data reception terminal 102 via digital broadcast . 

10 From the broadcasting station 101, multiplexed data obtained by 
multiplexing multimedia data and accompanying data (which. In this 
example , Is data for use In data broadcast ) related to the multimedia 
data Is broadcast . The present Invention can be applied to any 
system In which multimedia data and accompanying data are Inputted 

15 synchronously . Therefore , multimedia data may be data for a radio 
program using only sounds. Instead of data for a TV program, and 
the distribution form of multimedia data Is not restricted to 
broadcast but may be communication. 

As shown In FIG. 1, a communication system of the present 

20 Invention Includes a broadcasting station 101, a data reception 
terminal 102, a base station 103, a communication network 104, 
a base station 105, and a general-user terminal 106. The 
broadcasting station 101 and the data reception terminal 102 have 
a function relating to broadcast, and the data reception terminal 

25 102 and the general-user terminal 106 have a function relating 
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to electronic mall. The base station 103, the base station 105, 
and the communication network 104 relay an electronic mail which 
is exchanged between the data reception terminal 102 and the 
general-user terminal 106 . 
5 The data reception terminal 102, which is a characteristic 

feature of the present invention, is a terminal that has both a 
broadcast function which enables the reception of broadcast data 
and a communication function which enables the transmission and 
reception of an electronic mail, and is typically a mobile phone 

10 as illustrated in FIG . 2 . If a user of the data reception terminal 
102 who is viewing a TV program (which is being displayed on a 
display screen 201 ) finds himself or herself seeing an interesting 
scene which he or she desires to convey to another user, a scene 
specifying button 202 is pressed. This operation enables the 

15 acquisition of a point in time at which the scene specifying button 
202 has been pressed, information for identifying the TV program 
that has been viewed at the time, and information related to the 
TV progreun. This acquisition process will be described in detail 
later • 

20 FIG. 3 is a diagram illustrating a typical hardware 

configuration for realizing a data reception terminal 102 of the 
present invention . As shown in FIG • 3 , the data reception terminal 
102 includes a receiving section 301 for receiving a broadcast 
wave via an antenna, an output section 302 which is connected to 

25 a loudspeaker and/or the display screen 201, a storage section 
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303 for storing decoded broadcast data, a communication section 

304 for performing the transmission and reception of an electronic 
mail via the antenna or the like, a CPU 305 that takes charge of 
the overall control of the teirminal , a ROM 306 for storing a program, 

5 a RAM 307 that is utilized for the execution of the program, a 
button input section 308 that includes the scene specifying button 
202, and so on. All of these components are connected with one 
another . 

In the ROM 306 , a software program for implementing the system 
10 is stored. The CPU 305 executes the program stored in the ROM 
306, and performs a writing or updating of occurring data onto 
the RAM 307. In addition, as a result of executing the program, 
the CPU 305 receives at the receiving section 301a broadcast wave 
which is distributed from the broadcasting station 101, and outputs, 
15 via the output section 302, audio and video to the loudspeaker 
and the display screen 201, respectively. Further, the CPU 305 
accepts a key input by the user via the scene specifying button 
202 which is connected to the button input section 308 . Furthermore , 
the CPU 305 performs a transmission or reception of an electronic 
20 mail via the antenna which is connected to the communication section 
304. 

In the above, the data reception terminal 102 of the present 
invention has been described in terms of hardware configuration. 
Next , a characteristic mail creation method that the data reception 
25 terminal 102 of the present invention employs by utilizing at least 




some of those hardware components Is described In terms of software 
configuration . 

FIG. 4 is a diagram illustrating a software configuration 
of a data reception terminal 102 which employs the mail creation 
5 method according to an embodiment of the present invention. By 
being read by the CPU 305, the program stored in the ROM 306 as 
shown in FIG. 3 realizes the functions as a data reception section 
401, a decoding section 402, an video/audio output section 403, 
a related information storage section 404, a related infoarmation 

10 retrieval section 405, an input/output acceptance section 406, 
a format conversion section 407, a mail creation section 408, and 
a mail communication section 409. 

The data reception section 401 receives multiplexed data 
of a TV program which is broadcast from the broadcasting station 

15 101. The decoding section 402 separates the received multiplexed 
data into video/audio data and accompanying data that contains 
scene-related information, which is information related to a scene 
of a TV program. The video/audio output section 403 outputs video 
and audio. The related information storage section 404 stores 

20 and manages the accompanying data. The input /output acceptance 
section 406 detects a user's specifying of a scene, and generates 
predetermined scene specification information. The related 
information retrieval section 405 retrieves corresponding 
scene-related information based on the scene specification 

25 information. The format conversion section 407 converts the 



retrieved scene -related information into a format wtiich enables 
the retrieved scene -related information to be put into an 
electronic mail. The mail creation section 408 creates an 
electronic mail in which the scene-related information having been 
5 subjected to the format conversion is used. The mail communication 
section 409 transmits the created mail to the general-user terminal 
106. 

FIG. 5 and FIG. 6 are flowcharts illustrating the process 
procedure of the mail creation method according to the embodiment 

10 of the present invention, employed by the data reception terminal 
102 as constructed as described above. FIG. 5 is a flowchart of 
the processes concerning a broadcast receiving function , and FIG. 6 
is a flowchart of the processes concerning an electronic mail 
transmission function . 

15 With reference to FIG. 5, the processes concerning the 

broadcast receiving function are described . If the data reception 
terminal 102 receives a broadcast wave from the broadcasting 
station 101 (step S501) , the data reception texminal 102 performs 
a decoding process on the broadcast wave (step S502). The data 

20 reception terminal 102 outputs the video/audio data separated by 
the decoding to the display screen 201 or the loudspeaker, and 
stores the broadcast data separated by the decoding in the related 
information storage section 404 (step S503) . The broadcast data 
to be stored in the related information storage section 404 is 

25 data described in a progrsmd description language such as BML or 



the like. The above processes are performed continuously while 
broadcast waves are being received (step S504). 

With reference to FIG. 6, the processes concerning the 
electronic mall transmission function are described. If the user 
5 presses the scene specifying button 202 while viewing a TV program 
(step S601), the data reception terminal 102 generates scene 
specification Information which Includes a time , a channel , and/or 
the like (step S602). For example. In the case where the user 
viewing a TV program with the data reception terminal 102 attempts 

10 to transmit a scene 701 Illustrated In FIG. 7 to another user via 
mall, the scene specification Information Includes a time 801 at 
which the scene specifying button 202 Is pressed, a viewing channel 
802 on which the specified scene Is broadcast, and/or the like 
(FIG. 8A) . In the case where the user attempts to transmit a scene 

15 702 Illustrated In FIG. 7 to another user via mall, the scene 
specification Information Includes a time 804 at which the scene 
specifying button 202 Is pressed, a viewing channel 805 on which 
the specified scene Is broadcast , and/or the like ( FIG . 8B ) . Scene 
specification Information refers to data which Is capable of 

20 uniquely Identifying broadcast data, and may be the contents ID 
of a TV program or the like. 

Here, with reference to FIG. 9A and FIG. 9B, a supplementary 
description Is given concerning channels. In Japan, the 
multiplication of channels can be pointed out as a characteristic 

25 feature of digital broadcast, as known In BS digital broadcast. 



Although only one program can be assigned to one channel In the 
case of conventional analog broadcast, digital broadcast makes 
it possible to assign a plurality of programs to one channel. 
Usually, a plurality of programs included in one channel are 
5 distinguished by identifiers called service channels. 

Therefore, as shown in FIG. 8A and FIG. 8B, in the case where 
a plurality of pieces of scene specification information represent 
the same channel, respective corresponding broadcast data are 
identified by service channels 803 and 806 along with channels 
10 802 and 805. The service channels are used not only for 
distinguishing between utterly different programs but may also 
be used when the user selects a necessary service in the case where 
a plurality of services 902 are provided by one program, for exeunple 
(FIG. 9A) . 

15 With regard to terrestrial digital broadcasting , in the case 

of digital broadcast for a radio or a mobile terminal such as a 
mobile phone and the like, broadcast data is divided into thirteen 
segments, and at least some of the divided segments combined are 
put to use (FIG. 9B) . For example, the thirteen segments may be 

20 allocated among three applications: a mobile terminal, a radio, 
and a stationary terminal . A mobile terminal on the receiver side 
may receive one segment of the broadcast data 903 from among the 
thirteen segments of the broadcast data in order to realize stable 
reception and/or power saving, and use the service of only viewing 

25 of a progrcim titled "Documentary 'Project X' . " Similarly, a radio 



may use a high-quality sound service in addition to the narration 
of the documentary, by employing three segments of the broadcast 
data 904, whereas a stationary terminal may use a service such 
as audience participation discussion in connection with the 
5 documentary, which is realized in the form of chats done with other 
viewers via the communication network 104. 

As described above, in terrestrial digital broadcasting, 
combining of segments enables the utilization of different services , 
similarly to the services 902 in BS digital broadcast . Therefore , 

10 in the case where a plurality of services are included in one channel 
as a result of the digitization of broadcast, a method for 
identifying services, such as service channels, may also be 
incorporated into the scene specification information according 
to the present invention. 

15 With reference to FIG. 6 again, if the scene specification 

information is generated , the data reception terminal 102 retrieves , 
from the related information storage section 404, the broadcast 
data (e.g., BML data) of the scene corresponding to the scene 
specif ication information, i.e., scene-related information (step 

20 S603). For example, the time 801 and channel 802 of the scene 
specification information is associated with a part of the 
broadcast data 703 stored in the related information storage 
section 404, i.e., information 704. Consequently, the pressing 
of the scene specifying button 202 enables the acquisition of the 

25 information 704. Similarly, the time 804 and channel 805 of the 



scene specification Information Is associated with a part of the 
broadcast data 703, i.e., information 705. 

Next, the data reception terminal 102 performs the process 
of converting the format of the retrieved broadcast data so that 
5 the retrieved broadcast data can be used as scene -related 
information (step S604). The scene-related Information refers 
to text data relating to a scene, and Includes, for example, a 
program title, a person appearing in the program, a description 
of the scene. Information unknown to the user, and/or the like. 

10 In other words , this format conversion process corresponds to the 
process of extracting, from the information in the broadcast data, 
a text which is capable of being used in the body of an electronic 
mail. To give a specific explanation with reference to FIG. 7, 
the scene-related information refers to, within the broadcast data 

15 703, the title of a TV program placed between tags <title> and 
</title> , the name of a person appearing in or the neune of a feature 
in the program placed between tags <mailText> and </mallText>, 
and so on. Then, the scene -related information obtained after 
the format conversion, i.e. , the extracted text, is put into the 

20 body of an electronic mail (step S605). 

FIG. 10 is a diagram illustrating an exemplary display screen 
showing scene-related information which is put in the body of an 
electronic mall. In the case where broadcast data 1001 Includes 
scene-related Information 1002 to 1005 and a video file 1006, 

25 "MARATHON" (i.e., the scene-related information 1002) placed 



between tags <t±tle> and </title> within the broadcast data 1001 
is put into the subject 1009 of an electronic mail 1007 . In addition , 
"JOHN SMITH" (i.e., the scene-related information 1003), "LAST 
SPURT" (i.e. , the scene-related information 1004) , and "GOAL" (i.e., 
5 the scene -related information 1005 ) placed between tags <mailText> 
and </mailText> are put into the body 1010 of the electronic mail. 
The video file 1006 is attached to the electronic mail as an attached 
file 1011. 

Note that text data extracted as scene-related information 

10 by the format conversion does not need to be defined by the tags 
<title> and </title> or the tags <mailText> and </mailText> as 
in the above -described example, but may be defined in any other 
manner . Moreover , there is no limitation as to which scene-related 
information is to be used in the subject. In the case where there 

15 is no scene-related information to be used in the subject, 
information of an identifier of broadcast data (e.g., the file 
name of a moving image, audio, a still image, or the like in a 
relevant scene; a contents ID; or the like) may be used as the 
subject of a mail. Furthermore, in the case of the above -described 

20 example, since it is assiimed that broadcast data is written in 
BML, scene-related information is supposed to be text data. 
However, scene-related information may be binary data or the like 
as long as it is data usable for mail creation. 

If scene-related information has been put into the body of 

25 an electronic mail, the data reception terminal 102 determines 



whether it is necessary to edit the body of the electronic mail 
( step S606 ) . The editing here refers to making sentences by adding 
words such as conjunctions , verbs , and the like to the scene-related 
information which is merely placed together as shown in FIG. 10, 
so that a content which the user want s to convey is clearly expressed . 
In the case of the example of FIG. 11, for example, "'S," "JUST 
BEFORE , " and "MOVED ME" are added in the body 1010 of the electronic 
mail, so that a body 1102 is obtained after this editing. In the 
body 1102 of the electronic mail that is displayed after the user 
has made the editing, it is preferable that the scene-related 
information and a part added by the user be distinguished from 
each other by underlining and/or using different colors of letters , 
for excimple. 

Depending on the broadcasting station 101, it may so happen 
that making a change to the scene-related information is 
undesirable to the broadcasting station 101. Such an excunple is 
scene-related information which corresponds to a part related to 
a person's name, a part in which a copyright message is displayed, 
or the like. It is desirable that such scene-related infoirmation 
be protected against any editing by the user. This protection 
may be provided at the broadcasting station 101 side by defining 
a particular tag, or the data reception terminal 102 side may make 
a judgment and place a restraint as necessary. 

Note that the aforementioned technique of distinguishing 
user-added parts and the aforementioned technique of protecting 

18 



certain parts of the scene-related information, which have been 
described in connection with the body of an electronic mail, may 
also be applied to the subject part of an electronic mail. 

Then, the data reception terminal 102 performs a format 
5 conversion and a necessary editing (step S607) , and transmits the 
electronic mail, the editing of which has been completed, to a 
destination user (step S608). 

As described above, according to a data reception terminal 
and a mail creation method according to the embodiment of the present 

10 invention, text data (i.e. , scene-related information) to be used 
in an electronic mail is extracted from information associated 
with a specified scene. Consequently, it becomes possible to 
create an electronic mail easily and accurately. In particular, 
the body of an electronic mail can be created by only inputting 

15 words to be added between text data. Moreover, the operation of 
inputting the subject of an electronic mail by a user can be omitted. 
Furthermore, it is possible to visually distinguish between 
scene-related information and a part inputted by a user within 
the body of an electronic mail. 

20 Note that , among the functional blocks of the data reception 

terminal according to the present invention, the decoding section 
402, the related information retrieval section 405, the format 
conversion section 407, and the mail creation section 408 are 
typically realized as an LSI , which is an integrated circuit (which 

25 is called an IC, a system LSI, a super LSI, an ultra LSI, or the 



like depending on the degree of Integration) (see FIG. 4) . Each 
functional block may be separately constructed In a chip form, 
or all or some of the functional blocks may be constructed in a 
chip form. 

Moreover, the method of circuit Integration Is not limited 
to LSI, but may be realized by a dedicated circuit or a 
general-purpose processor. Furthermore, an FPGA (Field 
Programmable Gate Array) , which Is an LSI that can be programmed 
after manufacture, or a reconf Igurable processor enabling 
connections and settings of the circuit cells In the LSI to be 
reconfigured may be used. 

Still further, the advancement of semiconductor technology 
or another derivative technology may produce a technique for 
circuit integration that will replace LSI, in which case, as a 
matter of course, the integration of the functional blocks may 
be realized by utilizing that technique. A potential example is 
an application of biotechnology or the like. 

In addition, the mall creation method according to the 
present invention may be realized by a CPU interpreting and 
executing predetermined program data which is capable of carrying 
out the above -described process procedure, stored in a storage 
device (e.g., a ROM, a RAM, a hard disk, or the like). In this 
case, the program data may be introduced into the storage device 
via a recording medium such as a CD-ROM, a flexible disk, or the 
like, or may be executed directly from a recording medium. 

20 



INDUSTRIAL APPLICABILITY 
A data reception terminal and a mail creation method of the 
present invention can be employed when information related to 
multimedia data is transmitted via an electronic mail , for example , 
and are particularly useful when it is hoped that the creation 
of an electronic mail be performed in a short time and with ease, 
for example. 



